Pandas Profiling Report

Dataset statistics

Number of variables	23
Number of observations	729308
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	93.9 MiB
Average record size in memory	135.0 B

Variable types

NUM	15
CAT	7
BOOL	1

Warnings

`dropoff_datetime_hour` is highly correlated with `pickup_datetime_hour`	High correlation
`pickup_datetime_hour` is highly correlated with `dropoff_datetime_hour`	High correlation
`dropoff_datetime_woy` is highly correlated with `pickup_datetime_woy`	High correlation
`pickup_datetime_woy` is highly correlated with `dropoff_datetime_woy`	High correlation
`dropoff_datetime_doy` is highly correlated with `pickup_datetime_doy`	High correlation
`pickup_datetime_doy` is highly correlated with `dropoff_datetime_doy`	High correlation
`dropoff_datetime_moy` is highly correlated with `pickup_datetime_moy`	High correlation
`pickup_datetime_moy` is highly correlated with `dropoff_datetime_moy`	High correlation
`dropoff_datetime_dow` is highly correlated with `pickup_datetime_dow`	High correlation
`pickup_datetime_dow` is highly correlated with `dropoff_datetime_dow`	High correlation
`pickup_longitude` is highly skewed (γ1 = -444.2406389)	Skewed
`pickup_latitude` is highly skewed (γ1 = 35.3716491)	Skewed
`dropoff_longitude` is highly skewed (γ1 = -449.9053254)	Skewed
`dropoff_latitude` is highly skewed (γ1 = -23.50426371)	Skewed
`trip_duration` is highly skewed (γ1 = 25.58353865)	Skewed
`distance` is highly skewed (γ1 = 40.98349517)	Skewed
`speed` is highly skewed (γ1 = 194.6545591)	Skewed
`df_index` has unique values	Unique
`id` has unique values	Unique
`pickup_datetime_hour` has 26722 (3.7%) zeros	Zeros
`dropoff_datetime_hour` has 28910 (4.0%) zeros	Zeros

Reproduction

Analysis started	2020-12-24 16:25:47.298799
Analysis finished	2020-12-24 16:27:42.250453
Duration	1 minute and 54.95 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

df_index
Real number (ℝ_≥0)

UNIQUE

Distinct	729308
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	364661.1247
Minimum	0
Maximum	729321
Zeros	1
Zeros (%)	< 0.1%
Memory size	5.6 MiB

Quantile statistics

Minimum	0
5-th percentile	36466.35
Q1	182331.75
median	364661.5
Q3	546991.25
95-th percentile	692855.65
Maximum	729321
Range	729321
Interquartile range (IQR)	364659.5

Descriptive statistics

Standard deviation	210537.1167
Coefficient of variation (CV)	0.5773500448
Kurtosis	-1.199995945
Mean	364661.1247
Median Absolute Deviation (MAD)	182330
Skewness	-6.839068838e-07
Sum	2.659502755e+11
Variance	4.432587749e+10
Monotocity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2047	1	< 0.1%
538028	1	< 0.1%
726472	1	< 0.1%
568767	1	< 0.1%
566718	1	< 0.1%
572861	1	< 0.1%
570812	1	< 0.1%
560571	1	< 0.1%
558522	1	< 0.1%
564665	1	< 0.1%
Other values (729298)	729298	> 99.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%

Value	Count	Frequency (%)
729321	1	< 0.1%
729320	1	< 0.1%
729319	1	< 0.1%
729318	1	< 0.1%
729317	1	< 0.1%

id
Categorical

UNIQUE

Distinct	729308
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	5.6 MiB

id0764556	1
id2007948	1
id3832513	1
id0660360	1
id3379066	1
Other values (729303)	729303

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
id0764556	1	< 0.1%
id2007948	1	< 0.1%
id3832513	1	< 0.1%
id0660360	1	< 0.1%
id3379066	1	< 0.1%
id3690175	1	< 0.1%
id2446368	1	< 0.1%
id3461464	1	< 0.1%
id3098279	1	< 0.1%
id1425146	1	< 0.1%
Other values (729298)	729298	> 99.9%

Frequencies of value counts

Unique

Unique	729308 ?
Unique (%)	100.0%

Histogram of lengths of the category

Length

Max length	9
Median length	9
Mean length	9
Min length	9

vendor_id
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.3 KiB

2	390477
1	338831

Frequencies
Length

Value	Count	Frequency (%)
2	390477	53.5%
1	338831	46.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

passenger_count
Categorical

Distinct	9
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.6 KiB

1	517403
2	105096
5	38926
3	29692
6	24107
Other values (4)	14084

Frequencies
Length

Value	Count	Frequency (%)
1	517403	70.9%
2	105096	14.4%
5	38926	5.3%
3	29692	4.1%
6	24107	3.3%
4	14050	1.9%
0	32	< 0.1%
9	1	< 0.1%
7	1	< 0.1%

Frequencies of value counts

Unique

Unique	2 ?
Unique (%)	< 0.1%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

pickup_longitude
Real number (ℝ)

SKEWED

Distinct	19727
Distinct (%)	2.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	-73.97351416
Minimum	-121.933342
Maximum	-65.89738464
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	-121.933342
5-th percentile	-74.00688171
Q1	-73.99185944
median	-73.98175812
Q3	-73.96736145
95-th percentile	-73.89160156
Maximum	-65.89738464
Range	56.03595734
Interquartile range (IQR)	0.02449798584

Descriptive statistics

Standard deviation	0.06975319339
Coefficient of variation (CV)	-0.0009429482184
Kurtosis	306798.7741
Mean	-73.97351416
Median Absolute Deviation (MAD)	0.01175689697
Skewness	-444.2406389
Sum	-53949475.67
Variance	0.004865507988
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-73.98213959	317	< 0.1%
-73.98220062	316	< 0.1%
-73.98210144	308	< 0.1%
-73.98226166	297	< 0.1%
-73.98209381	296	< 0.1%
-73.98220825	288	< 0.1%
-73.98223877	286	< 0.1%
-73.9822464	285	< 0.1%
-73.9821167	284	< 0.1%
-73.98238373	283	< 0.1%
Other values (19717)	726348	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-121.933342	1	< 0.1%
-79.56973267	1	< 0.1%
-78.54740143	1	< 0.1%
-77.89601898	1	< 0.1%
-77.03943634	1	< 0.1%

Value	Count	Frequency (%)
-65.89738464	1	< 0.1%
-70.51190186	1	< 0.1%
-71.8816452	1	< 0.1%
-72.07433319	1	< 0.1%
-72.4212265	1	< 0.1%

pickup_latitude
Real number (ℝ_≥0)

SKEWED

Distinct	39775
Distinct (%)	5.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	40.7509192
Minimum	34.7122345
Maximum	51.88108444
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	34.7122345
5-th percentile	40.70815659
Q1	40.73733521
median	40.75407028
Q3	40.76831436
95-th percentile	40.78828049
Maximum	51.88108444
Range	17.16884995
Interquartile range (IQR)	0.03097915649

Descriptive statistics

Standard deviation	0.03359367798
Coefficient of variation (CV)	0.0008243661405
Kurtosis	19349.80421
Mean	40.7509192
Median Absolute Deviation (MAD)	0.01529312134
Skewness	35.3716491
Sum	29719971.38
Variance	0.0011285352
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
40.77410126	202	< 0.1%
40.77407837	201	< 0.1%
40.77412033	197	< 0.1%
40.77408981	196	< 0.1%
40.77405167	196	< 0.1%
40.77410889	194	< 0.1%
40.77415848	182	< 0.1%
40.7741394	181	< 0.1%
40.77407074	171	< 0.1%
40.77413177	167	< 0.1%
Other values (39765)	727421	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
34.7122345	1	< 0.1%
35.31030655	1	< 0.1%
37.38938141	1	< 0.1%
37.777771	1	< 0.1%
38.89884949	1	< 0.1%

Value	Count	Frequency (%)
51.88108444	1	< 0.1%
43.91176224	1	< 0.1%
43.48688507	1	< 0.1%
43.13965225	1	< 0.1%
42.45894241	1	< 0.1%

dropoff_longitude
Real number (ℝ)

SKEWED

Distinct	27891
Distinct (%)	3.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	-73.97342304
Minimum	-121.9333038
Maximum	-65.89738464
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	-121.9333038
5-th percentile	-74.00753021
Q1	-73.99131775
median	-73.97975922
Q3	-73.96303558
95-th percentile	-73.92024994
Maximum	-65.89738464
Range	56.03591919
Interquartile range (IQR)	0.02828216553

Descriptive statistics

Standard deviation	0.0695878374
Coefficient of variation (CV)	-0.0009407140366
Kurtosis	309935.976
Mean	-73.97342304
Median Absolute Deviation (MAD)	0.01315307617
Skewness	-449.9053254
Sum	-53949409.21
Variance	0.004842467114
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
-73.98233032	239	< 0.1%
-73.98209381	224	< 0.1%
-73.99140167	222	< 0.1%
-73.9821167	220	< 0.1%
-73.9822464	217	< 0.1%
-73.98220062	212	< 0.1%
-73.98222351	212	< 0.1%
-73.98235321	208	< 0.1%
-73.99134064	206	< 0.1%
-73.99137878	205	< 0.1%
Other values (27881)	727143	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-121.9333038	1	< 0.1%
-80.3554306	1	< 0.1%
-79.81797791	1	< 0.1%
-79.78613281	1	< 0.1%
-79.51861572	1	< 0.1%

Value	Count	Frequency (%)
-65.89738464	1	< 0.1%
-70.51190186	1	< 0.1%
-71.8816452	1	< 0.1%
-72.02240753	1	< 0.1%
-72.4212265	1	< 0.1%

dropoff_latitude
Real number (ℝ_≥0)

SKEWED

Distinct	53578
Distinct (%)	7.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	40.75177559
Minimum	32.1811409
Maximum	43.92102814
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	32.1811409
5-th percentile	40.69980621
Q1	40.7359314
median	40.75450897
Q3	40.76974106
95-th percentile	40.79736328
Maximum	43.92102814
Range	11.73988724
Interquartile range (IQR)	0.03380966187

Descriptive statistics

Standard deviation	0.03603704846
Coefficient of variation (CV)	0.0008843062159
Kurtosis	5639.454966
Mean	40.75177559
Median Absolute Deviation (MAD)	0.01668930054
Skewness	-23.50426371
Sum	29720595.95
Variance	0.001298668862
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
40.75014877	145	< 0.1%
40.75017166	137	< 0.1%
40.75003815	136	< 0.1%
40.75014114	132	< 0.1%
40.77433014	126	< 0.1%
40.75009155	126	< 0.1%
40.75019836	125	< 0.1%
40.75011826	124	< 0.1%
40.75598145	123	< 0.1%
40.77431107	122	< 0.1%
Other values (53568)	728012	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
32.1811409	1	< 0.1%
35.17354584	1	< 0.1%
37.38951111	1	< 0.1%
37.777771	1	< 0.1%
38.47829819	1	< 0.1%

Value	Count	Frequency (%)
43.92102814	1	< 0.1%
43.91176224	1	< 0.1%
43.48688507	1	< 0.1%
43.13965225	1	< 0.1%
42.45894241	1	< 0.1%

store_and_fwd_flag
Boolean

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.3 KiB

N	725268
Y	4040

Common Values
Chart

Value	Count	Frequency (%)
N	725268	99.4%
Y	4040	0.6%

trip_duration
Real number (ℝ_≥0)

SKEWED

Distinct	6294
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	949.5877009
Minimum	2
Maximum	86391
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	2
5-th percentile	180
Q1	397
median	663
Q3	1075
95-th percentile	2102
Maximum	86391
Range	86389
Interquartile range (IQR)	678

Descriptive statistics

Standard deviation	3127.54733
Coefficient of variation (CV)	3.293584497
Kurtosis	684.7457004
Mean	949.5877009
Median Absolute Deviation (MAD)	311
Skewness	25.58353865
Sum	692541907
Variance	9781552.304
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
348	830	0.1%
368	808	0.1%
363	808	0.1%
388	805	0.1%
358	798	0.1%
404	793	0.1%
337	791	0.1%
376	788	0.1%
307	787	0.1%
354	787	0.1%
Other values (6284)	721313	98.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
2	102	< 0.1%
3	163	< 0.1%
4	139	< 0.1%
5	136	< 0.1%
6	95	< 0.1%

Value	Count	Frequency (%)
86391	1	< 0.1%
86387	1	< 0.1%
86378	1	< 0.1%
86377	1	< 0.1%
86369	2	< 0.1%

pickup_datetime_moy
Categorical

HIGH CORRELATION

Distinct	6
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.4 KiB

3	128314
4	125630
5	124200
2	119361
6	117406

Frequencies
Length

Value	Count	Frequency (%)
3	128314	17.6%
4	125630	17.2%
5	124200	17.0%
2	119361	16.4%
6	117406	16.1%
1	114397	15.7%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

pickup_datetime_hour
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	24
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.61177308
Minimum	0
Maximum	23
Zeros	26722
Zeros (%)	3.7%
Memory size	5.6 MiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	9
median	14
Q3	19
95-th percentile	22
Maximum	23
Range	23
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	6.402809936
Coefficient of variation (CV)	0.4703876489
Kurtosis	-0.7222696722
Mean	13.61177308
Median Absolute Deviation (MAD)	5
Skewness	-0.4455755069
Sum	9927175
Variance	40.99597507
Monotocity	Not monotonic

Histogram with fixed size bins (bins=24)

Value	Count	Frequency (%)
18	45404	6.2%
19	45261	6.2%
20	42165	5.8%
21	42045	5.8%
22	40293	5.5%
17	38313	5.3%
14	37120	5.1%
12	35818	4.9%
15	35687	4.9%
13	35629	4.9%
Other values (14)	331573	45.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	26722	3.7%
1	19243	2.6%
2	13960	1.9%
3	10424	1.4%
4	7827	1.1%

Value	Count	Frequency (%)
23	35068	4.8%
22	40293	5.5%
21	42045	5.8%
20	42165	5.8%
19	45261	6.2%

pickup_datetime_woy
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	27
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.84390134
Minimum	1
Maximum	53
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	7
median	13
Q3	20
95-th percentile	25
Maximum	53
Range	52
Interquartile range (IQR)	13

Descriptive statistics

Standard deviation	8.558288252
Coefficient of variation (CV)	0.6181991652
Kurtosis	3.948221195
Mean	13.84390134
Median Absolute Deviation (MAD)	6
Skewness	1.178425445
Sum	10096468
Variance	73.24429781
Monotocity	Not monotonic

Histogram with fixed size bins (bins=27)

Value	Count	Frequency (%)
14	30411	4.2%
15	30079	4.1%
9	30059	4.1%
18	29792	4.1%
11	29563	4.1%
6	29480	4.0%
8	29361	4.0%
20	29325	4.0%
10	28878	4.0%
19	28829	4.0%
Other values (17)	433531	59.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	26474	3.6%
2	28286	3.9%
3	22681	3.1%
4	26983	3.7%
5	28110	3.9%

Value	Count	Frequency (%)
53	9973	1.4%
26	14949	2.0%
25	27084	3.7%
24	27143	3.7%
23	27798	3.8%

pickup_datetime_dow
Categorical

HIGH CORRELATION

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.6 KiB

4	111744
5	110249
3	109344
2	105071
1	101252
Other values (2)	191648

Frequencies
Length

Value	Count	Frequency (%)
4	111744	15.3%
5	110249	15.1%
3	109344	15.0%
2	105071	14.4%
1	101252	13.9%
6	97679	13.4%
0	93969	12.9%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

pickup_datetime_doy
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	182
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	91.88311386
Minimum	1
Maximum	182
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	1
5-th percentile	11
Q1	48
median	92
Q3	136
95-th percentile	173
Maximum	182
Range	181
Interquartile range (IQR)	88

Descriptive statistics

Standard deviation	51.55562169
Coefficient of variation (CV)	0.5611000708
Kurtosis	-1.159208695
Mean	91.88311386
Median Absolute Deviation (MAD)	44
Skewness	-0.001481419285
Sum	67011090
Variance	2657.982128
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	4900	0.7%
107	4846	0.7%
65	4784	0.7%
72	4682	0.6%
64	4673	0.6%
58	4669	0.6%
106	4658	0.6%
128	4651	0.6%
99	4638	0.6%
93	4634	0.6%
Other values (172)	682173	93.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	3588	0.5%
2	3228	0.4%
3	3157	0.4%
4	3341	0.5%
5	3594	0.5%

Value	Count	Frequency (%)
182	3877	0.5%
181	3838	0.5%
180	3632	0.5%
179	3602	0.5%
178	3590	0.5%

dropoff_datetime_moy
Categorical

HIGH CORRELATION

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.6 KiB

3	128282
4	125629
5	124235
2	119358
6	117380
Other values (2)	114424

Frequencies
Length

Value	Count	Frequency (%)
3	128282	17.6%
4	125629	17.2%
5	124235	17.0%
2	119358	16.4%
6	117380	16.1%
1	114371	15.7%
7	53	< 0.1%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

dropoff_datetime_hour
Real number (ℝ_≥0)

HIGH CORRELATION
ZEROS

Distinct	24
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.60621987
Minimum	0
Maximum	23
Zeros	28910
Zeros (%)	4.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	9
median	14
Q3	19
95-th percentile	23
Maximum	23
Range	23
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	6.486347395
Coefficient of variation (CV)	0.4767192841
Kurtosis	-0.7263072763
Mean	13.60621987
Median Absolute Deviation (MAD)	5
Skewness	-0.4637741247
Sum	9923125
Variance	42.07270253
Monotocity	Not monotonic

Histogram with fixed size bins (bins=24)

Value	Count	Frequency (%)
19	46852	6.4%
18	44862	6.2%
20	42789	5.9%
21	41848	5.7%
22	40724	5.6%
23	36599	5.0%
15	36446	5.0%
14	36124	5.0%
17	36014	4.9%
12	35716	4.9%
Other values (14)	331334	45.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	28910	4.0%
1	20885	2.9%
2	14887	2.0%
3	11013	1.5%
4	8474	1.2%

Value	Count	Frequency (%)
23	36599	5.0%
22	40724	5.6%
21	41848	5.7%
20	42789	5.9%
19	46852	6.4%

dropoff_datetime_woy
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	27
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.84297718
Minimum	1
Maximum	53
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	7
median	13
Q3	20
95-th percentile	25
Maximum	53
Range	52
Interquartile range (IQR)	13

Descriptive statistics

Standard deviation	8.555330412
Coefficient of variation (CV)	0.6180267656
Kurtosis	3.942279069
Mean	13.84297718
Median Absolute Deviation (MAD)	6
Skewness	1.176534395
Sum	10095794
Variance	73.19367847
Monotocity	Not monotonic

Histogram with fixed size bins (bins=27)

Value	Count	Frequency (%)
14	30409	4.2%
15	30080	4.1%
9	30048	4.1%
18	29795	4.1%
11	29564	4.1%
6	29471	4.0%
8	29365	4.0%
20	29321	4.0%
10	28882	4.0%
19	28831	4.0%
Other values (17)	433542	59.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	26488	3.6%
2	28268	3.9%
3	22688	3.1%
4	26981	3.7%
5	28102	3.9%

Value	Count	Frequency (%)
53	9946	1.4%
26	14978	2.1%
25	27086	3.7%
24	27141	3.7%
23	27792	3.8%

dropoff_datetime_dow
Categorical

HIGH CORRELATION

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	712.6 KiB

4	111509
5	110286
3	108918
2	104940
1	101141
Other values (2)	192514

Frequencies
Length

Value	Count	Frequency (%)
4	111509	15.3%
5	110286	15.1%
3	108918	14.9%
2	104940	14.4%
1	101141	13.9%
6	98558	13.5%
0	93956	12.9%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

dropoff_datetime_doy
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	183
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	91.89431214
Minimum	1
Maximum	183
Zeros	0
Zeros (%)	0.0%
Memory size	5.6 MiB

Quantile statistics

Minimum	1
5-th percentile	11
Q1	48
median	92
Q3	136
95-th percentile	173
Maximum	183
Range	182
Interquartile range (IQR)	88

Descriptive statistics

Standard deviation	51.55641851
Coefficient of variation (CV)	0.5610403659
Kurtosis	-1.159205774
Mean	91.89431214
Median Absolute Deviation (MAD)	44
Skewness	-0.001492861615
Sum	67019257
Variance	2658.064289
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
100	4903	0.7%
107	4853	0.7%
65	4802	0.7%
72	4692	0.6%
58	4661	0.6%
128	4657	0.6%
106	4646	0.6%
64	4629	0.6%
93	4621	0.6%
44	4611	0.6%
Other values (173)	682233	93.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	3552	0.5%
2	3221	0.4%
3	3173	0.4%
4	3344	0.5%
5	3595	0.5%

Value	Count	Frequency (%)
183	53	< 0.1%
182	3864	0.5%
181	3830	0.5%
180	3637	0.5%
179	3594	0.5%

distance
Real number (ℝ_≥0)

SKEWED

Distinct	726232
Distinct (%)	99.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.138251114
Minimum	0
Maximum	771.0659931
Zeros	2897
Zeros (%)	0.4%
Memory size	5.6 MiB

Quantile statistics

Minimum	0
5-th percentile	0.3703227188
Q1	0.7659758823
median	1.302249156
Q3	2.408757991
95-th percentile	6.830951969
Maximum	771.0659931
Range	771.0659931
Interquartile range (IQR)	1.642782109

Descriptive statistics

Standard deviation	2.704898481
Coefficient of variation (CV)	1.265005061
Kurtosis	9795.507455
Mean	2.138251114
Median Absolute Deviation (MAD)	0.6611833846
Skewness	40.98349517
Sum	1559443.643
Variance	7.316475794
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2897	0.4%
0.0002635704874	21	< 0.1%
0.0002635704872	20	< 0.1%
0.0002635704869	18	< 0.1%
0.000790711461	13	< 0.1%
0.0002635704867	12	< 0.1%
0.0005271409739	10	< 0.1%
0.0002635704876	8	< 0.1%
0.0002635704865	8	< 0.1%
0.0005271409741	8	< 0.1%
Other values (726222)	726293	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2897	0.4%
0.0002635704858	1	< 0.1%
0.0002635704858	1	< 0.1%
0.0002635704861	1	< 0.1%
0.0002635704861	4	< 0.1%

Value	Count	Frequency (%)
771.0659931	1	< 0.1%
357.2115437	1	< 0.1%
339.1781185	1	< 0.1%
198.9172154	1	< 0.1%
195.5856845	1	< 0.1%

speed
Real number (ℝ_≥0)

SKEWED

Distinct	726394
Distinct (%)	99.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	8.960500414
Minimum	0
Maximum	3504.845423
Zeros	2897
Zeros (%)	0.4%
Memory size	5.6 MiB

Quantile statistics

Minimum	0
5-th percentile	3.132438836
Q1	5.669613674
median	7.951610556
Q3	11.08760375
95-th percentile	18.31075623
Maximum	3504.845423
Range	3504.845423
Interquartile range (IQR)	5.41799008

Descriptive statistics

Standard deviation	7.658905795
Coefficient of variation (CV)	0.8547408562
Kurtosis	77253.68241
Mean	8.960500414
Median Absolute Deviation (MAD)	2.597411864
Skewness	194.6545591
Sum	6534964.636
Variance	58.65883798
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2897	0.4%
0.3162845849	4	< 0.1%
0.1897707506	3	< 0.1%
0.09488537561	2	< 0.1%
0.07298875041	2	< 0.1%
0.09488537546	2	< 0.1%
0.03953557307	2	< 0.1%
0.09182455677	2	< 0.1%
0.1054281949	2	< 0.1%
0.3558201576	2	< 0.1%
Other values (726384)	726390	99.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	2897	0.4%
1.665061704e-05	1	< 0.1%
2.933512205e-05	1	< 0.1%
3.437170215e-05	1	< 0.1%
0.0004868034222	1	< 0.1%

Value	Count	Frequency (%)
3504.845423	1	< 0.1%
2539.368708	1	< 0.1%
876.1499935	1	< 0.1%
874.957018	1	< 0.1%
839.9344498	1	< 0.1%

trip_duration_minutes
Real number (ℝ)

Distinct	6294
Distinct (%)	0.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2.370417623
Minimum	-3.401197382
Maximum	7.27229422
Zeros	91
Zeros (%)	< 0.1%
Memory size	5.6 MiB

Quantile statistics

Minimum	-3.401197382
5-th percentile	1.098612289
Q1	1.889591718
median	2.402430428
Q3	2.885731378
95-th percentile	3.556299989
Maximum	7.27229422
Range	10.6734916
Interquartile range (IQR)	0.9961396599

Descriptive statistics

Standard deviation	0.7980667351
Coefficient of variation (CV)	0.3366776923
Kurtosis	4.049775234
Mean	2.370417623
Median Absolute Deviation (MAD)	0.4978384282
Skewness	-0.3437861951
Sum	1728764.536
Variance	0.6369105137
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1.757857918	830	0.1%
1.813738376	808	0.1%
1.800058272	808	0.1%
1.866660777	805	0.1%
1.786188424	798	0.1%
1.907070316	793	0.1%
1.725738368	791	0.1%
1.835244581	788	0.1%
1.774952351	787	0.1%
1.632503185	787	0.1%
Other values (6284)	721313	98.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
-3.401197382	102	< 0.1%
-2.995732274	163	< 0.1%
-2.708050201	139	< 0.1%
-2.48490665	136	< 0.1%
-2.302585093	95	< 0.1%

Value	Count	Frequency (%)
7.27229422	1	< 0.1%
7.272247918	1	< 0.1%
7.272143731	1	< 0.1%
7.272132153	1	< 0.1%
7.272039532	2	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Count
Matrix

First rows

	df_index	id	vendor_id	passenger_count	pickup_longitude	pickup_latitude	dropoff_longitude	dropoff_latitude	store_and_fwd_flag	trip_duration	pickup_datetime_moy	pickup_datetime_hour	pickup_datetime_woy	pickup_datetime_dow	pickup_datetime_doy	dropoff_datetime_moy	dropoff_datetime_hour	dropoff_datetime_woy	dropoff_datetime_dow	dropoff_datetime_doy	distance	speed	trip_duration_minutes
0	0	id1080784	2	1	-73.953918	40.778873	-73.963875	40.771164	N	400	2	16	9	0	60	2	16	9	0	60	0.745070	6.705632	1.897120
1	1	id0889885	1	2	-73.988312	40.731743	-73.994751	40.694931	N	1100	3	23	10	4	71	3	23	10	4	71	2.565714	8.396883	2.908721
2	2	id0857912	2	2	-73.997314	40.721458	-73.948029	40.774918	N	1635	2	17	7	6	52	2	18	7	6	52	4.505415	9.920181	3.305054
3	3	id3744273	2	6	-73.961670	40.759720	-73.956779	40.780628	N	1141	1	9	1	1	5	1	10	1	1	5	1.467120	4.628950	2.945316
4	4	id0232939	1	1	-74.017120	40.708469	-73.988182	40.740631	N	848	2	6	7	2	48	2	6	7	2	48	2.689630	11.418241	2.648536
5	5	id1918069	2	2	-73.993614	40.751884	-73.995422	40.723862	N	1455	2	18	6	6	45	2	18	6	6	45	1.938501	4.796292	3.188417
6	6	id2429028	1	1	-73.965080	40.758915	-73.976807	40.764107	N	397	4	20	16	2	111	4	20	16	2	111	0.710837	6.445873	1.889592
7	7	id1663798	2	1	-73.963890	40.765434	-73.872429	40.774200	N	1101	6	16	24	6	171	6	17	24	6	171	4.824077	15.773550	2.909630
8	8	id2436943	2	2	-73.872887	40.774281	-73.979019	40.761879	N	1886	3	19	13	0	88	3	19	13	0	88	5.619470	10.726453	3.447869
9	9	id2933909	1	1	-73.987823	40.740982	-73.999153	40.686451	N	1429	4	22	14	6	101	4	22	14	6	101	3.814175	9.608837	3.170386

Last rows

	df_index	id	vendor_id	passenger_count	pickup_longitude	pickup_latitude	dropoff_longitude	dropoff_latitude	store_and_fwd_flag	trip_duration	pickup_datetime_moy	pickup_datetime_hour	pickup_datetime_woy	pickup_datetime_dow	pickup_datetime_doy	dropoff_datetime_moy	dropoff_datetime_hour	dropoff_datetime_woy	dropoff_datetime_dow	dropoff_datetime_doy	distance	speed	trip_duration_minutes
729298	729312	id3683137	2	1	-73.984779	40.779781	-73.998718	40.739777	N	1526	1	0	53	4	1	1	1	53	4	1	2.858708	6.744002	3.236061
729299	729313	id3993907	1	1	-73.994034	40.751015	-74.003738	40.722240	N	1325	2	11	5	4	36	2	11	5	4	36	2.052004	5.575257	3.094823
729300	729314	id3226129	2	2	-73.987740	40.748222	-73.949585	40.680737	N	1338	3	3	12	0	81	3	4	12	0	81	5.072936	13.649155	3.104587
729301	729315	id3234032	1	1	-73.984116	40.725372	-73.982544	40.731377	N	110	6	6	26	1	180	6	6	26	1	180	0.422943	13.841767	0.606136
729302	729316	id2031090	2	1	-73.974487	40.783138	-73.952629	40.772270	N	449	1	22	4	0	25	1	22	4	0	25	1.368133	10.969439	2.012678
729303	729317	id3905982	2	2	-73.965919	40.789780	-73.952637	40.789181	N	296	5	13	20	5	142	5	13	20	5	142	0.696075	8.465780	1.596015
729304	729318	id0102861	1	1	-73.996666	40.737434	-74.001320	40.731911	N	315	2	0	8	0	53	2	0	8	0	53	0.452797	5.174820	1.658228
729305	729319	id0439699	1	1	-73.997849	40.761696	-74.001488	40.741207	N	673	4	18	15	4	106	4	19	15	4	106	1.428395	7.640745	2.417401
729306	729320	id2078912	1	1	-74.006706	40.708244	-74.013550	40.713814	N	447	6	9	24	6	171	6	9	24	6	171	0.525877	4.235251	2.008214
729307	729321	id1053441	2	4	-74.003342	40.743839	-73.945847	40.712841	N	1224	1	17	53	4	1	1	17	53	4	1	3.694577	10.866404	3.015535

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows